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INVENTORY SYSTEM WITH IMAGE DISPLAY 

CROSS-REFERENCE TO RELATED APPLICATIONS 

The present application is a continuation-in-part of U. S. Patent Application No. 
5 09/734,360, filed December 1, 2000, which is hereby incorporated by reference in its entirety. 

BACKGROUND 

The present invention generally concerns material handling systems, and more 
specifically, but not exclusively concerns an integrated material handling systems with image 

10 display capabilities. 

To manage and control inventories, companies have been adopting automated light 
directed inventory systems so as to reduce paperwork and increase efficiency. In a usual light 
directed inventory system, pick/put to light (PTL) devices are used to direct an operator's 
attention to a particular bin, shelf location, or carousel in a warehouse. For instance, a light 

15 on the PTL device may illuminate so that the operator knows which storage location needs to 
be serviced. Once at the desired storage location, the operator can add (put), remove (pick) 
or count the required items at the storage location. 

Although PTL devices have increased supply chain efficiency, there is always the risk 
that items may be moved or bins can be rearranged so that the operator removes or adds the 

20 wrong item. Since typical PTL devices at the most only display the desired quantities of 
items, the operator can never be sure that the right item handled. These and other types of 
handling errors can sometimes create dire circumstance, especially in the medical industry. 
For example, if an employee of a pharmaceutical company or hospital retrieves the wrong 
medication, a patient's health may be placed in jeopardy. 

25 Cost is always a concern for any type of inventory system. Even though the PTL 

device systems improve efficiency, the initial purchase price and maintenance costs 
associated the PTL devices may offset any economic advantage gained by their installation. 
Typical light directed inventory systems require a PTL device to be positioned at every 
storage location so that an operator is able to identify the storage location. Even in a 

30 modestly sized warehouse, the number of PTL devices needed to service each location can 
become quite large. In addition, some storage locations are not suitable to have PTL devices 
mounted close by. Thus, there remains a need for improvement in this field. 
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SUMMARY 

One form of the present invention concerns a technique in which a pick/put to display 
device is provided with an image display and an indicator light. The indicator light is 

5 illuminated to alert an operator of a service to be performed on an item at a storage location. 
A service instruction for the item is displayed on the image display, and an image of the item 
is displayed on the image display. 

Another form concerns a technique for reducing the number of pick/put to display 
devices needed for a storage area. A pick/put to display device with an image display is 

10 positioned between a first storage location and a second storage location. A first arrow 

pointing toward the first storage location and a first instruction for servicing the first storage 
location are displayed on the image display. A second arrow pointing toward the second 
storage location and a second instruction for servicing the second storage location are 
displayed on the image display. 

15 A further form concerns a technique in which an operator is alerted of a service to be 

performed on an item at a storage location with a pick/put to device that has an image 
display. Instructions concerning the item at the storage location are displayed on the image 
display. An image concerning the item at the storage location is displayed on the image 
display. 

20 A further form concerns a system that includes a pick/put to display device that is 

positioned proximal a storage location. The pick/put to display device includes a processor 
that is operable to download an instruction and an image that concern an item associated with 
the storage location. Memory is operatively coupled to the processor, and an indicator light 
is operatively coupled to the processor to alert an operator of a servicing task for the item at 

25 the storage location. An image display is operatively coupled to the processor to display the 
instruction and the image concerning the item at the storage location. 

In another form, a system includes a first storage location configured to store a first 
item and a second storage location configured to store a second item. A pick/put to display 
device is positioned between the first storage location and the second storage location to 

30 handle service instructions for both the first storage location and the second storage location. 
The pick/put to display device has an image display configured to display a first arrow that 
points toward the first storage location and a second arrow that points to the second storage 
location. 
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Other forms, embodiments, objects, features, advantages, and aspects of the present 
invention shall become apparent from the detailed drawings and description contained herein. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a diagrammatic view of an inventory system. 

FIG. 2 is a diagrammatic view of a pick/put to display (PTD) device used in the FIG. 
5 1 system. 

FIG. 3 is a front view of the FIG. 2 PTD device displaying a pick item screen. 
FIG. 4 is a front view of the FIG. 3 PTD device positioned to handle multiple storage 
locations. 

FIG. 5 is a front view of the FIG. 3 PTD device displaying a multiple location arrows 

10 screen. 

FIG. 6 is a flow diagram illustrating one technique for outputting media content with 
the FIG. 3 PTD device. 

FIG. 7 is a front view of the FIG. 3 PTD device displaying a biohazard screen. 
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DESCRIPTION OF SELECTED EMBODIMENTS 

For the purposes of promoting an understanding of the principles of the invention, 
reference will now be made to the embodiments illustrated in the drawings and specific 
language will be used to describe the same. It will nevertheless be understood that no 
5 limitation of the scope of the invention is thereby intended. Any alterations and further 

modifications in the described embodiments, and any further applications of the principles of 
the invention as described herein are contemplated as would normally occur to one skilled in 
the art to which the invention relates. One embodiment of the invention is shown in great 
detail, although it will be apparent to those skilled in the art that some of the features which 

10 are not relevant to the invention may not be shown for the sake of clarity. 

FIG. 1 depicts, with a diagram, an inventory management system 100 according to 
one embodiment of the present invention. The system 100 includes at least one host 102, one 
or more pick/put to display (PTD) gateways (or routers) 104, and one or more pick/put to 
display (PTD) devices 106. The host 102 stores information about inventoried items and 

15 manages orders for the items. In one embodiment, the host 102 includes a file server that 
stores inventory information, and in one particular form, the host 102 includes a personal 
computer. As should be appreciated, in other embodiments, multiple computers can be 
operatively coupled together to form the host 102. It nevertheless contemplated that the host 
102 can include other types of computing devices as would occur to those skilled in the art. 

20 The host 102 and the PTD devices 106 communicate with one another by sending messages 
over a network 108. For example, the host 102 can send a message to one of the PTD 
devices 106 so that the PTD device 106 alerts an operator of a servicing task for a specific 
item, such as picking a predefined number of items from a bin. 

The PTD devices 106 are normally located near one or more inventory storage 

25 locations, and the PTD devices 106 are used to alert operators of tasks and provide 

instructions concerning the tasks. As will be discussed in greater detail below, the PTD 
devices 106 according to the present invention are able to provide task or service instructions 
for multiple inventory locations and/or items, thereby reducing the number of PTD devices 
106 needed in the system 100. As illustrated in FIG. 1, the host 102 and the PTD devices 106 

30 communicate with one another via the PTD gateways 104. In one embodiment, the gateway 
includes a computer. However, as should be appreciated, the PTD gateways 104 include any 
type of computer gateway as would occur to those skilled in the art. The PTD gateways 104 
communicate with the server 102 through the network 108. The network 108 includes any 
type of communication network as would occur to those skilled in the art. By way of non- 
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limiting examples, the network 108 can include the Internet and/or one or more other Wide 
Area Networks (WAN), a Local Area Network (LAN), a proprietary network such as 
provided by America On Line, Inc., or a combination of these, to name a few. 

In the illustrated embodiment, the PTD devices 106 communicate to the server 102 
5 through a wired and/or wireless connection. Referring to FIG. 1, the PTD devices 106 
include a wired PTD device 110 that is operatively coupled to a wired PTD gateway 112 
through a controller area network (CAN) 114. In another illustrated form, the wired PTD 
device 1 10 is operatively coupled through CAN 1 14 to a wireless PTD gateway 1 16. The 
wireless PTD gateway 116 communicates with a second wireless PTD gateway 116, wireless 

10 access point 118, through a wireless network 120. The PTD devices 106 further include a 
wireless PTD device 122 that communicates with the wireless access point 118 through the 
wireless network 120. As should be appreciated, the inventory system 100 in other 
embodiments can include additional components, exclude selected components and/or can be 
configured in a different manner. For example, the system 100 in other embodiments can 

15 exclusively include wired PTD devices 1 10 or wireless PTD devices 122. 

A diagrammatic view of one of the PTD devices 106 is illustrated in FIG. 2. As 
depicted, the PTD device 106 includes a processor 202 for controlling the operation of the 
PTD device 106 and processing communications with the host 102. The processor 202 may 
be comprised of one or more components. For a multi-component form of the processor 202, 

20 one or more components can be located remotely relative to the others, or configured as a 
single unit. Furthermore, processor 202 can be embodied in a form having more than one 
processing unit, such as a multiprocessor configuration, and should be understood to 
collectively refer to such configurations as well as a single-processor-based arrangement. 
One or more components of processor 202 may be of the electronic variety defining digital 

25 circuitry, analog circuitry or both. Processor 202 can be of a programmable variety 

responsive to software instructions, a hardwired state machine, or a combination of these. 

As depicted in FIG. 2, the processor 202 communicates with and/or controls a number 
of components in the PTD device 106. These components in the illustrated embodiment 
include at least each one of the following: memory 204; an indicator light 206; an image 

30 display 208; a manual input device or key pad 210; a microphone 212; and a speaker 214 that 
are each operatively coupled to the processor 202. It is contemplated that in other 
embodiments at least some of these components can be directly operatively coupled to one 
another and/or selected components can be added or removed. Among its many functions, 
memory 204 stores information that is related to inventory storage locations and items, such 
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as images, videos (movies), sound (voice) recordings, file addresses, text instructions, 
product descriptions and product quantities, to name a few. Memory 204 can include one or 
more types of solid state electronic memory, magnetic memory, or optical memory, just to 
name a few. By way of nonlimiting examples, the memory can include solid state electronic 
random access memory (RAM), sequential access memory (SAM), such as first-in, first-out 
(FIFO) variety or last-in, first-out (LIFO) variety, programmable read only memory (PROM), 
electronically programmable read only memory (EPROM), or electronically erasable 
programmable read only memory (EEPROM); an optical disc memory (such as a DVD or 
CDROM); a magnetically encoded hard disc, floppy disc, tape, or cartridge media; or a 
combination of these memory types. In addition, the memory 204 may be volatile, non- 
volatile, or a hybrid combination of volatile, non-volatile varieties. 

The processor 202 illuminates the indicator light 206 to direct the attention of the 
operator to a selected PTD device 106. The indicator light 206 includes any type of 
illumination device as would occur to those skilled in the art. By way of nonlimiting 
examples, the indicator light 206 can include an incandescent light bulb, a fluorescent light 
bulb, a light emitting diode (LED) or a combination of these. The processor 202 on the image 
display 208 displays images of items, direction arrows, instructions, quantities and other 
information. The images displayed on the image display 208 can be animated (such as a 
video), static, two-dimensional and/ or three-dimensional. The image display 208 includes 
any type of image displaying device as would occur to those skilled in the art. By way of 
non-limiting examples, the image display 208 can include a liquid crystal type display 
(LCD), an LED type display, a cathode ray tube (CRT), an organic light emitting diode 
(OLED) type display, and/or a plasma display, to name just a few. In one embodiment, the 
image display 208 includes an OLED type display in order to conserve energy in the PTD 
device 106 and to improve the viewable angle of the image display 208. OLED type displays 
have a wide viewable angle of approximately one hundred and seventy degrees (170°), which 
in turn improves the overall visibility of the image display 208 to the operator in a warehouse 
type environment. With the display capabilities of the image display 208, the PTD device 
106 is able to provide instructions for multiple inventory locations, and provide greater 
flexibility in the format and type of instructions. In the PTD device 106, the image display 
capabilities of display 208 can reinforce the textual instructions by providing an image of the 
item to be picked from, put into or counted at an individual storage location. Moreover, 
animations or videos can be shown on the image display 208 to illustrate techniques for 
handling and packaging items as well as other information. 
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The operator interfaces with the PTD device 106 through the keypad 210. It should 
be understood that the keypad 210 can encompass other types manual input devices, such as a 
mouse or a digitized pen, for example. The keypad 210 includes one or more buttons that are 
used by the operator to manually enter information. For example, the operator can change 
5 the quantities picked or select menu options with the keypad 210. The operator can also 
interface with the PTD device 106 vocally via the microphone 212 and receive voice 
instructions or other audio signals through the speaker 214. For instance, in addition to or as 
a substitute for the indicator light 206 being illuminated, the speaker 214 can emit a sound, 
such as a voice command, to direct the attention of the operator to a particular PTD device 

10 106. The vocal/audio interface provided by the microphone 212 and the speaker 214 allows 
for hands-free operation of the PTD device 106. For instance, in response to a voice 
instruction from the speaker 214 of the PTD device 106, the operator can audibly instruct the 
PTD device 106 through the microphone 212 that a task has been completed. 

A PTD device 106 according to one embodiment of the present invention is illustrated 

15 in FIG. 3. As shown, the indicator light 206, image display 208, keypad 210, microphone 
212 and speaker 214 are mounted to a housing 302. While not shown, the processor 202 and 
memory 204 in the embodiment depicted in FIG. 3 are mounted inside the housing 302. In 
the illustrated embodiment, the keypad 210 includes menu buttons 304 and a task complete 
button 306. To prevent the wrong buttons from being accidentally pushed, the menu 304 and 

20 task complete 306 buttons are positioned on opposite sides of the image display 208. As 

illustrated, the menu buttons 304 are positioned near the image display 108 so that the menu 
buttons 304 can be used to navigate a menu system that is displayed on the image display 
208. The menu buttons 304 are also used to adjust the actual quantity handled in an order, 
and the menu buttons 304 can further be used to rotate three dimensional images on the 

25 image display 208 or control playback of sounds (voice recordings) and videos (i.e., fast 
forward and rewind). 

In the illustrated embodiment, the menu buttons 304 include first 308, second 310 and 
third 312 menu buttons. However, it is contemplated that in other embodiments the menu 
buttons 304 can include more or less buttons than depicted. Referring to FIG. 3, the image 
30 display 208 is operable to display increase quantity 314 and decrease quantity 316 indicators, 
which are positioned near the first 308 and second 310 menu buttons, respectively. By 
pressing the first menu button 308, the operator is able to increase the quantity, and the 
operator is able to decrease the quantity by pressing the second menu button 308. In one 
form, when the first 308 and second 310 buttons are pressed at the same time, the actual 
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quantity is set to zero. In the screen displayed on the image display of FIG. 3, a menu 
indicator 318 is displayed on the image display 208 proximal the third menu button 312, such 
that the operator gains access to the menu system of the PTD device 106 by pressing the third 
menu button 312. Once the particular service task is complete, the operator in one 
embodiment presses the task complete button 306 in order to notify the PTD device 106 that 
the task is completed. It is contemplated that in other embodiments the operator can verbally 
communicate to the PTD device 106 that the task is complete through the microphone 212. 

As noted above, the image display 208 gives the PTD device 106 the ability to handle 
multiple storage locations, and further, gives the PTD device 106 the ability to display images 
of items or images associated with items so as to reduce handling errors. Ensuring that the 
correct item is added or removed from a storage location (or counted) can be especially 
critical in industries that have similar looking items, such as the pharmaceutical industry 
where pills can look very similar. Furthermore, certain items, such as hazardous or fragile 
items, may require special handling procedures that are not easily conveyed through text 
alone, but are easily understood visually. The image display 208 of the present invention has 
the ability to visually convey such information, thereby reducing many types of 
inventory/handling problems. By being positioned near the storage location being serviced, 
the PTD device 106 can be a readily available source of information for the operator. In 
contrast, typical paper-based, manuals are usually rather large and are centrally located at one 
location, which in turn discourages their use. 

In FIG. 3, the image display 208 shows an image 320 of an item to be picked, which 
in the illustrated example is a bolt. It should be understood that other types of images 320 
can be shown on the image display 208 in conjunction with other types of instructions. For 
example, the image 320 can be of the package in which the item is packed, additional views 
of the item, icons, warning signs and instructional pictures or videos for the item. The image 
display 208 is further configured to display textual information, such as a name or description 
of an item 322, an instruction 324 (i.e., pick, put, or count) and quantity 326. 

In addition, the image display 208 is operable to display a location arrow 328 that 
indicates the location of where the task is to be performed. As will be appreciated from the 
discussion below, displaying the location arrow 328 on the image display 208 gives the PTD 
device 106 the flexibility to provide instructions for multiple storage locations regardless of 
the position of the storage location relative to the PTD device 106. The image display 208 is 
further capable of displaying location arrows 328 of different sizes, shapes, colors and/or 
styles as well allows the locations arrows 328 to be animated. This capability of modifying 
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the location arrows 328 displayed on the image display 208 allows the PTD device 108 to be 
easily configured for different environmental conditions. For example, if the PTD device 106 
is located on an upper shelf of a storage bay, the properties of the location arrow 328 can be 
adjusted so that the location arrow 328 is easily visible. In another example, to provide 
directions to a designated PTD device 106 that requires a service to be performed, the 
location arrows 328 on nearby PTD devices 106 can be animated so as to point and move 
towards the designated PTD device 106. 

The image display 208 is further capable of displaying additional information in order 
to locate an item. As should be appreciated, individual storage locations can be further 
subdivided or partitioned to form separate compartments or cells in which different items are 
stored. As depicted in FIG. 3, the image display 208 is further capable of displaying cell 
location icons or indicators 330 that indicate the particular cell to service. In the image 
display 208, the cell icons 330 can be arranged to correspond to the relative locations of cells. 
For example, the image display 208 in FIG. 3 shows cell icons 330 for cell locations "A", "B" 
and n C" in a row. The cell icon 330 for cell "A" is highlighted to indicate that, for the storage 
location where the location arrow 328 points, the operator should pick four (4) bolts from cell 
"A". 

Referring to FIG. 4, an example of an inventory storage system 400 is illustrated in 
which the PTD device 106 is mounted to service multiple storage or service locations 402 at 
the same time. Although the embodiment will be described with reference to a shelving unit 
with bins, it should be appreciated that the PTD device 106 can be used in other types of 
situations. In the illustrated embodiment, the PTD device 106 is mounted between four (4) 
storage locations 402, which each contain a bin 404 in which items are stored. To indicate 
the bin 404 to be serviced, the PTD device 106 displays on the image display 208 the location 
arrow 328 that points to the desired storage location 402. In the example illustrated in FIGS. 
3 and 4, the location arrow 328 points towards the storage bin 404 that is located at the upper, 
right side of system 400, and the PTD device 106 further indicates that four (4) bolts should 
be picked from the designated bin 404. It should be understood that, with the added 
flexibility provided by the image display 208, the PTD device 106 can be easily reconfigured 
to handle more or less storage locations 402 than is shown. For example, if the layout of a 
warehouse is changed, the PTD device 106 can be easily re-installed at a different location. 

As shown in FIG. 5, the image display 208 is capable of displaying location arrows 
328 that accurately point in a multitude of directions. In one embodiment, the image display 
328 is capable of displaying location arrows 328 that are able to point throughout a full three 
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hundred and sixty-degree (360°) range. Having the ability to accurately point to storage 
locations 402 with the location arrows 328 on the image display 208, helps to reduce the 
chance the operator will mistakenly service the wrong storage location 402. Location arrows 
328 are also able to point in non-orthogonal directions so that, if the PTD device 106 were 
installed closer to one storage location 402 and farther away from others, the location arrow 
328 can be adjusted to accurately point toward the actual locations of the storage locations 
402. 

As previously mentioned, the image display 208 and speaker 214 give the PTD device 
106 the ability to display and/or play media content, such as images of items or voice-base 
instructions, thereby enriching the instructional information available to the operator. A 
technique for displaying and/or playing media content on the PTD device 106 will now be 
described with reference to a flow chart 600 in FIG. 6. To aid in understanding the 
technique, a communication protocol for the inventory management system 100 will be 
described below. It, however, should be understood that the present invention is not intended 
to be limited to just the communication protocol described below, and it is contemplated that 
other types communication protocols are can be used in communications between the host 
102 and the PTD device 106. 

According to one embodiment of the present invention, extensible markup language 
(XML) is used in communications between the PTD devices 106 and the host 102. Using 
XML allows for greater flexibility in system design and improves interoperability. Table 1 
below lists a detailed description of the XML tags that are sent by the host 102 to the PTD 
device. It is contemplated other types of tag names can be used. 

Table 1 



Host to PTD Device 


Tag 


Tag Description 


Data 


Attribute 






REQUIRED TAGS 




SID 


Source ID 


TCP/IP address for source of message. 
Required tag. 


N/A 


DID 


Device ID 


TCP/IP address for destination device. 
Required tag. 


N/A 


OP 


Operation 


Operation values: 

1=Pick. Pick operations. 
2=Put. Put operations. 
3=llluminate. Light device. 
4=Count. Count operations. 
7=Ping. Receive status of PTD's. 
8=Reset. Resets devices. 
9=Set Location. Sets menu data. 
1 0=Self test. Runs PTD test. 
1 1 =Sleep. Sets to sleep mode. 
12=SetlD. Set ID for PTD. 
13=Generic FTP 

Required tag. 


B (Beep) X/Y/Z where 

0=No beep (default) 
X=Beep frequency in 
seconds 

Y=Timer where beep 
frequency changes 
Z=New beep frequency 
after timer expires. 

Example: Beep 7/1 20/2 causes 
the device to beep every 7 
seconds until the device has 
been illuminated for 2 minutes 
with no task complete. After the 
2 minutes is up, beeps every 2 
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seconds. 














OPTIONAL TAGS 




AFTP 


Audio FTP File 


FTP file name of the audio file associated 
with the device and location specified in the 
message. PTD client will use FTP to 
connect to the server and download the 
sound (i.e., .WAV) file. Location is 
identified by the arrow direction. 


A (IP Address) (default=Host IP 
address) 

P (Path) (default^ login directory) 


ARW 


Arrow 


Product association index. An associated 
Screen Layout file contains screen position 
(relative to quantity) where arrow displays: 

1=TOP(default) 

2=BOTTOM 

3=LEFT 

4=RIGHT 

5=NE (points northeast) 
6=NW (points northwest) 
7=SE (points southeast) 
8=SW (points southwest) 

Note: Also provided on location set up to 
indicate which location info relates to (top, 
bottom, left, right) for the device. 


I (Intensity) 

0=No display (default) 
1=Low intensity on 
display 

2=Med. Intensity on 
display 

3=High intensity on 
display 

S (Size) 

0=Small 
1=Medium 
2=Large 
3=Extra Large 

F (Flash) 

0=no flash 
1 =slow 
2=fast 
C (Color) 1-4 


DSC 


Product 
Description 


Product description for the product ID 
associated with the device and location 
specified in the message. Location is 
identified by the arrow direction. 


Display attributes for the product: 
F (Flash) 

0=no flash 
1 =slow 
2=fast 

If not provided, assume 
solid display. 
C (Color) 1-4 

L (Label) screen display label for 
this info (Part Desc, Product 
Desc, etc.). 


IFTP 


Image FTP File 


FTP file name of the image associated with 
the device and location specified in the 
message. PTD client will use FTP to 
connect to the server and download the 
image file. Location is identified by the arrow 
direction. 


A (IP Address) (default=Host IP 
address) 

P (Path) (default= login directory) 


IND 


Indicator light 
illumination 


Values are: 

0=No illumination 

1=Solid- default 

2=Flash 

3=Rapid flash 
If tag is not provided, indicator light is 
illuminated. 


N/A 


ITS 


Presence of 
instruction text 
lines. 

Header level tag 


When ITS is supplied, one or more IT tags 
are supplied as well. This is a node, not an 
element. Holds a collection of IT tags. 


N/A 


IT 


Instruction text 
details 


Instruction text may contain any textual 
information. 

If tag is not provided or empty, nothing 
displays, no illumination. 


F (Flash) 

0=no flash 
1 =slow 
2=fast 

If not provided, assume 
solid display. 
C (Color) 1-4 

L (Line) line number of display 


LOT 


Lot Number 


Alphanumeric Lot number stored at the 
location. Location is identified by the arrow 
direction. 


Display attributes for the product: 
F (Flash) 

0=no flash 

1=slow 

2=fast 

If not provided, assume 
solid display. 
C (Color) 1-4 

L (Label) screen display label for 
this info (lot number, batch 
number, etc.). 
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NDl 


New Device ID 


New PTD device IP address for the 'Set ID' 
command. 


P (Port) (default=1357) 


PID 


Product ID 


Alphanumeric product ID associated with the 
device and location specified in the 
message. Location is identified by the arrow 
direction. 


Display attributes for the product: 
F (Flash) 

0=no flash 
1 =slow 
2=fast 

If not provided, assume 
solid display. 
C (Color) 1-4 

L (Label) screen display label for 
this info (Part #, Product ID, SKU, 
etc.). 


PLY 


Play Audio/Video 


This tag specifies if the product audio/video 

should be played. 

Values: 

0=Do not play (default) 
1=Play audio at task complete time 
2=Play audio to alert attention 
3=Play video at task complete time 
4=Play video to alert attention 

If tag is not provided, no audio/video plays 

automatically. May still be initiated through 

menu option. 


N/A 


POS 


Position 


This tag has several uses: 

• Cell for light tower or sort bar. 

• May also be used to indicate pick 
position. Typically 1 -3 characters. 

• May also be used to indicate 
operator with work at this location 
in the event multiple operators are 
picking in an area. 

If tag is not provided or empty, no position 
data displays. 


F (Flash) 

0=no flash 
1 =slow 
2=fast 

If not provided, assume 
solid display. 
C (Color) 1-4 


QTY 


Quantity 


Quantity to be picked/put at the location. 

If quantity tag is not supplied or empty, no 
quantity displays. If 'A' attribute is not 
supplied, only the or down adjustment 
button is active. 


A (Adjustment) 

0 = Down only-default 

1 = Adjust up & down 

2 = Adjust up only 

3 = No adjustments 
allowed. 

F (Flash) 

0=no flash 
1 =slow 
2=fast 

If not provided, assume 
solid display. 
C (Color) 1-4 


SCR 


Screen Layout 


Specifies screen layout to be utilized. 
1 =Default screen, TOP 
2=Default screen, BOTTOM 
3=Default screen, LEFT 
4=Default screen, RIGHT 
9=Text screen 

1 3=Display Tower screen, left 

14=Display Tower screen, right 

21=TOP Put 

22=BOTTOM Put 

23=LEFT Put 

24=RIGHT Put 

25=NE (points north east) Put 

26=NW (points north west) Put 

27=SE (points south east) Put 

28=SW (points south west) Put 

31=TOP Count 

32=BOTTOM Count 

33= LEFT Count 

34=RIGHT Count 

35=NE (points north east) Count 

36=NW (points north west) Count 

37=SE (points south east) Count 

38=SW (points south west) Count 

If tag is not provided, ARW based default 


B (Background color) 1 -4 
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screen layout will be utilized. When supplied 
with "Set Location" identifies default screen. 




SFTP 


Screen FTP File 


FTP file name of the image associated with 
the required screen specified in the 
message. (SCRxx.XML where XX=screen 
layout number in SCR tag) PTD client will 
use FTP to connect to the server and 
download the image. 


A (IP Address) (defau!t=Host IP 
address) 

P (Path) (default= login directory) 


TC 


Task Complete 


Indicates whether the task complete button 
on the device is active. 

0 = Yes (default) 

1 = No 

If tag is not provided or empty, both task 
complete button and auxiliary input are 
active. 


B (Button) 
1=Auxillary input is inactive 
(default) 
2=Button is inactive 
3=Both auxiliary and button are 
inactive 


TDI 


Troubleshooting 
Device ID 


IP address where devices should send 
unsolicited status messages. Host will send 
at initial set up. Host will have a service 
monitoring unsolicited error messages via a 
TCP socket. 


P (Port) (defaults 359) 


TMR 


Timer 


Applies to operation 1 1 (sleep). Amount of 
time sleep in seconds. 


N/A 


VFTP 


Video FTP File 


FTP file name of the video file. PTD client 
will use FTP to connect to the server and 
download the video. 


A (IP Address) (default=Host IP 
address) 

P (Path) (default= login directory) 



Some notable commands from Table 1 that are sent from the host 102 will be 
described below. For the sake of brevity, not all of the tags and/or their attributes will be 
described in detail. Instead, please refer to Table 1 for a detailed description of the tags and 
their attributes. The source identification ("SID") and Device identification ("DID") tags 
provide the network address for the host 102 and the PTD device 106, respectively. The 
operation tag ("OP") is used to instruct the PTD device 106 what operation to perform. 
Typically, the source identification, device identification and operation tags are sent in every 
communication from the server 102 to the PTD device 106. The host to PTD device ("HTP") 
tag or element is used signify messages sent from the host 102 to the PTD device 106, and 
the PTD device to host tag ("PTH") tag is used in communications from the PTD device 106 
to the host 102. 

Within the operation tag, a number of operational commands can be sent. For 
example, the ping command ("7") can be sent to query and receive status information from 
one or more PTD devices 106 on the system 100. When sent, the reset command ("8") clears 
the memory 204 of one or more PTD devices 106 on the system 100. To send pick 
instruction to the PTD device 106, the pick command ("1") is used, and the put command 
("2") is used for sending put away instructions to the PTD device 106. The count command 
("4") is used in providing instruction for counting of items at a particular location, and the 
illuminate command ("3") is sent to illuminate the indicator light 206 and/or image display 
208 of a selected PTD device 106. As will be described in greater detail below, the host 102 
sends the set location command ("9") to download screen information, location product ID, 
product description, image, video and/or audio data to the PTD device 106 for a particular 
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location. When the test command ("10") is sent from the host 102, one or more of the PTD 
devices 106 perform a self-diagnostic test and return status messages to the host 102. The set 
identification command ("11") sets the network address for a designated PTD device 106, and 
in return, the PTD device 106 sends to the host 102 a status response, which provides the 
5 status of the PTD device 106. The generic FTP command ("13") instructs the PTD device 
106 to download files from the host 102 or another computer. 

Some other tags that can be sent by the host 102 include the audio transfer ("AFTP"), 
image transfer ("HTTP"), screen transfer ("SFTP") and the video transfer ("VFTP") 
commands, which are used to identify the network addresses of audio, image, screen and 

10 video files to be downloaded onto the PTD device 106. The quantity tag ("QTY") is used to 
indicate the quantity to be added or removed from a designated storage location 402. The 
arrow tag ("ARW") denotes the location arrow 328 to display and signifies a particular 
storage location 402, which in turn is used for storing item information in memory 204. For 
example, if an arrow tag value of five ("5") is sent to the PTD device 106, the location arrow 

15 328 on the PTD device 106 would point toward the upper right corner storage location 402 
(in a northeast direction), as is shown in FIG. 3. In this example, the item information 
associated with the northeast storage location 402, such as product description and 
instructions, would be stored in memory 204 under the number five ("5") or northeast 
pointing location arrow 328. It is contemplated that in other embodiments the arrow tag 

20 value can signify the angular orientation of the location arrow 328 (in degrees or radians). 

Below in Table 2 is an example of an XML message that is sent by the host 102 to request the 
PTD device 106 to show a pick four ("4") instruction with the location arrow 328 pointing in 
a northeast direction (see, FIGS. 3 and 4). 

Table 2 

25 <?xml versions" 1.0" encoding="utf-8"?> 

<HTP xmlns= M HTP.XSD"> 
<SID>10.0.0.134</SID> 
<DID> 10.0.0. 1 35</DID> 
<OP>l</OP> 
30 <ARW>5</ARW> 
<QTY >4</QTY> 
</HTP> 

In the above example, the number one ("1") in the operation tag indicates that a "pick" 
35 operation needs to be performed, and the arrow tag value of five ("5") indicates that the pick 
operation should occur at the northeast storage location 402. The number four ("4") in the 
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quantity tag signifies that four (4) items should be picked from the bin 404 at the northeast 
storage location 402. In response to receipt of this message, the processor 202 of the PTD 
device 106 will display the "pick" instruction 324, the number four ("4") as the quantity value 
326 and the northeast pointing location arrow 328 on the image display 208, as is shown in 
5 FIG. 3. By default, if additional information concerning the storage location 402 is stored in 
memory 204, such as a product description or an image of the product, the processor 202 of 
the PTD device 106 will display on the image display 208 the additional information. In the 
example illustrated in FIG. 3, the additional information for the northeast pointing location 
arrow 328 includes an image 320 of a bolt and a "bolt" product description 322. 

10 Referring again to Table 1, the product description tag ("DSC") is used to supply a 

description of the product for a particular location, which is indicated by the location arrow 
328. The indicator light ("IND") tag is used to control the illumination of the indicator light 
206. The instruction text presence ("IT") and details ("ITS") are used to display instructions 
on the image display 208 of the PTD device 106. A lot number for a particular storage 

15 location (designated by the given location arrow) is indicated with the lot number tag 

("LOT"). The new address identification ("NDI") tag is used to set a new network address 
for a PTD device 106. Products can be identified through the product identification tag 
("PID"). The host 102 can control the playing of audio, video and/or other types of files via 
the play ("PLY") tag. In Table 1, the position tag ("POS") can have several uses. One use 

20 includes, indicating a cell for a light tower or sort bar. The position tag can also indicate a 
pick position or an operator where multiple operators are at the same location. 

With reference to FIG. 3, the layout of the screen displayed on the image display 208 
can be controlled via the screen tag ("SCR"). The screen layouts can specify the location, 
size, color and animation of text and arrows. Further, the screen layouts can specify the 

25 location and size of images displayed on the screen. In the PTD device 106, the host 102 can 
control the operation of the task complete button through the task complete tag ("TC"), and 
the time that the PTD device 106 remains in sleep mode can be controlled through the timer 
tag ("TMR"). The host 102 can conduct troubleshooting of PTD devices 106 through the 
troubleshooting tag ("TDI"). Table 3, below, summarizes the tags that can be used with each 

30 of the operation commands. 
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Table 3 



v^perauon 


Tags 


1=Pick 


• ARW. Arrow direction 

• IND. Indicator Light 

• POS. Position 

• QTY. Quantity 

• TC. Task complete enabled 

• IT. Instruction text 

• SCR. Screen layout to be used 

• PLY. Play audio/video 


<£=rUt 


• ARW. Arrow direction 

• IND. Indicator Light 

• POS. Position 

• QTY. Quantity 

• TC. Task complete enabled 

• IT. Instruction text 

• SCR. Screen layout to be used 

• PLY. Play audio/video 


3=llluminate 
— 


• IND. Indicator Light 

• IT. Instruction Text 

• SCR. Screen layout to be used 


4=Count 


• ARW. Arrow direction 

• IND. Indicator Light 

• POS. Position 

• QTY. Quantity 

• TC. Task complete enabled 

• IT. Instruction text 

• SCR. Screen layout to be used 

• PLY. Play audio/video 


7=Ping 


N/A 


8=Reset 


N/A 


y=oei Location 


• AFTP. Audio FTP path 

• ARW. Arrow to indicate location 

• Uoo. rrouuct aescnption 

• IFTP. Image FTP path 

• M. insirucxion iexi 

• LOT Lot number 

• PID. Product ID 

• SCR. Default screen layout 

• VFTP. Video FTP path 


10=Self Test 


N/A 


11=Sleep 


• TMR. Sleep timer 


12=Set ID 


• NDI. New PTD device IP address 

• TDI. Diagnostic Manager device IP address 


13=Generic FTP 


• SFTP. Screen layout FTP path 
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By combining the above-described tags in a message, the host 102 can supply a 
myriad of instructions to the PTD device 106. 

In Table 4 below, examples are shown of some tags for messages that can be sent by 
the PTD devices 106 to the host 102, according to one embodiment. It again should be 
appreciated that other types of communication protocols can be used. 

Table 4 



PTD Device to Host 


Tag 


Tag Description 


Data 


Attribute 






REQUIRED TAGS 




SID 


Source ID 


TCP/IP address for source of message. 
Required tag. 


N/A 


DID 


Device ID 


TCP/IP address for destination device. 
Required tag. 


N/A 


OP 


Operation 


Operation values: 

5=Complete. Task complete. 

6=Status. Initiated by PTD. 

7=Set Up. 
Required tag. 


N/A 














OPTIONAL TAGS 




AQT 


Actual Quantity 


Actual quantity picked/put at the location. 


N/A 


DST 


Device status 


Values are: 

0=Device OK 

1 =Error condition 
If device status is 1 , ECS and EC tags are 
provided. 


N/A 


ECS 


Presence of error 
conditions. 
Header level tag 


When ECS is supplied, one or more EC tags 
are supplied as well. This is a node, not an 
element. Holds a collection of EC and ETX 
tags. 


N/A 


EC 


Error condition 
details 


One or more error conditions may be 

present. Values are: 

1=lnvalid device 
2=Battery low 
3=Display unit problem 
4=Stuck task complete button 
5=Invalid message format 
6=Set ID failed 
7=Lost power to device 
8=Lost network connection 
9=FTP transfer error 

etc. 


N/A 


ETX 


Error text 


Text information about an error condition. 


EC (Error Condition) 


OQT 


Original Quantity 


Original quantity requested to be picked/put 
at the location. 


N/A 



The source identification ("SID") and device identification ("DID") tags, which 
provide network address information, are similar to the ones described above for the host 
102. The operation tag ("OP") is used to send operational indicators to the host 102. These 
operational indicators include a task complete indicator ("5"), a status indicator ("6") and a 
set up indicator ("7"). Once a task is complete, such as when an operator pushes the task 
complete button 306, the PTD device 106 sends a message that contains the task complete 
indicator. The status indicator provides information about the status of the PTD device 106, 
and the set up indicator is used in setting up the PTD device 106. In the embodiment of 
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Table 4, each message the PTD device 106 sends to the host 102 needs to include the source 
identification, device identification and operation tags. However, it should be appreciated 
that in other embodiments the messages can be required to contain other types of information 
and/or instructions. 

5 The status of the PTD device 106 and any error conditions in the PTD device 106 are 

communicated through a device status tag ("DST"), which indicates whether or not the PTD 
device 106 is operating properly. When the device status tag indicates that an error in the 
PTD device 106 has occurred ("1"), the error condition header tag ("ECS") as well as one or 
more error condition detail tags ("EC") are sent in the message to tell the host 102 what errors 
10 occurred. Optionally, an error text tag ("ETX") can be supplied to provide text for the error 
condition. 

Some other tags that the PTD device 106 can send in a message include an actual 
quantity tag ("AQT"), which indicates the actual quantity of items picked/put (or counted) at 
a location, and an original quantity tag ("OQT"), which indicates the original quantity the 
15 host 102 requested. A sample "task complete" message from the PTD device 106 in response 
to the sample "pick" message from the host 102, which was described above with reference to 
FIGS. 3 and 4, is provided below in Table 5. 

Table 5 

<?xml version= M 1.0" encoding="utf-8"?> 
20 <PTH xmlns="PTH.xsd"> 

<SID> 1 0.0.0. 1 35</SID> 
<DID> 10.0.0. 1 34</DID> 
<OP>5</OP> 
<OQT>4</OQT> 
25 <AQT>4</AQT> 
</PTH> 

In the above discussed example, the host 102 sent a message instructing the PTD 
device 106 to display a "pick 4" instruction along with a northeast pointing location arrow 

30 328 on the image display 208. For this sample message, the operator picked four (4) from the 
designated location, and therefore, did not need to change the displayed quantity value 326. 
If quantity actually picked was different from the quantity requested, the operator can press 
the first 308 or second 310 menu buttons to increase or decrease the quantity. After the 
operator has completed the task, the operator can press the task complete button 306 on the 

35 PTD device 106. Once the task complete button 306 is pressed, the processor 202 in the PTD 
device 106 generates and sends the above message to the host 102. In the sample message, 
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the PTD device 106 indicates with the original quantity tag that the host requested four ( M 4") 
items to be picked and with the actual quantity tag that four ("4") items were indeed picked. 
If the operator adjusted the actual quantity picked to a different value, the actual quantity tag 
would contain the different value. Although the above example was described with reference 

5 to a pick service operation, it should be appreciated that the above sample messages, with 
some slight modifications, would be equally applicable for put or count instructions. 

As noted above, each location arrow 328 is associated with a particular storage 
location 402 such that information concerning an item at a storage location 402, such as 
product information or handling instructions, is stored in memory 204 of the PTD device 106 

10 in association with the particular location arrow 328. So for example in FIGS. 3 and 4, when 
bolts are stored in the upper right corner (northeast) bin 404, the information for the bolts is 
saved in memory 204 in association with the northeast pointing location arrow 328 (arrow 
number "5" in Table 1). For example, the product information can include a picture of the 
bolt, a video/animation showing the bolt being removed from the bin 404, a voice recording 

15 on how to handle the bolt, a part number for the bolt, and text that provides instructions for 
the bolt. Referring to FIG. 6, to store information about a designated storage location 402 in 
memory 204, the host 102 in stage 602 sends a set location information message to the PTD 
device 106. A sample set location message from the host 102 that sets the location 
information for the bolt is provided below in Table 6. 

20 Table 6 

<?xml versions' 1.0 M encoding="utf-8 M ?> 
<HTP xmlns="HTP.XSD"> 

<SID> 10.0.0. 1 34</SID> 

<DID> 10.0.0.13 5</DID> 
25 <OP>9</OP> 

<ARW>5</ARW> 

<PID>10-3432</PID> 

<DSC>Bolt</DSC> 

<AFTP P= M ASAP^SERVER\SOUNDV , >10-3432.WAV</AFTP> 
30 <IFTP P= n ASAP_SERVER\IMAGES\ M >10-3432JPG</IFTP> 

<VFTP P= M ASAP_SERVER\VroEOY^10-3432.AVI</VFTP> 
</HTP> 

In stage 602, the processor 202 of the PTD device 106 receives the set location 
35 information message from the host 102 and stores the message content in memory 204. As 
mentioned above, the product information is stored in memory 204 in association with the 
location arrow 328 designated in the message. After receiving the above set location 
message, the processor 202 of the PTD device 106 stores in memory 204 under location 
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arrow number "5" (northeast pointing arrow) the product ID "10-3432" and the product 
description "bolt". As will be described in greater detail below, in one embodiment, the 
processor 202 stores in memory 204 under the northeast location arrow 328, the network 
address/path for the sound file from the audio tag (" AFTP"), the network address/path for the 
5 image file from the image tag ("HTTP") and the network address/path for the video file from 
the video tag ("VFTP"). In another embodiment, the sound, image and video files are 
directly stored in memory 204 in association with the northeast pointing location ("5") arrow 
328. 

In stage 604, the processor 202 of the PTD device 106 downloads the files from the 

10 host 102 and/or from other file sources. As should be appreciated, the files can be 

downloaded from a number of sources, including the host 102 and/or file servers that are 
accessible to the PTD device 106. In one form of the present invention, the PTD device 106 
in stage 604 downloads the files using the file transfer protocol (FTP). In this form, the PTD 
device 106 logs in as an "anonymous" user and uses the IP address of the PTD device 106 as 

15 the password. The transfers occur in binary mode. However, it should be appreciated that 
the files can be downloaded in other manners as would occur to those skilled in the art. If 
during stage 606, the processor 202 of the PTD device 106 determines that an error occurred 
during downloading of the files, the processor 202 sends a message to the host 102 that an 
error has occurred during downloading in stage 608. On the other hand, if no errors occur 

20 during downloading, the PTD device 106 outputs the media content from the files via the 
image display 208 and/or speaker 214. 

As mentioned above, in one embodiment, only the network addresses/paths (i.e., the 
IP address and/or path) for the sound, image and/or video files are stored in memory 204 
under the location arrow, and these media content files are downloaded (stage 604) on an as 

25 needed basis so as to conserve memory. If for example the PTD device 106 in this 

embodiment received the above sample message, the processor 202 would then store under 
the northeast pointing ("5") location arrow 328 the following file names/paths in memory 
204: "ASAP_SERVER\SOUND\10-3432.WAV"; "ASAP_SERVER\IMAGES\10- 
3432.JPG"; and " AS AP_SERVER\VIDEO\l 0-3432.AVI". Afterwards, when the PTD 

30 device 106 receives instructions that require one or more of the files, the files are then 
downloaded at that time. The operator or host 102 can send the instructions to the PTD 
device 106 to initiate the download process. For example, when the PTD device 106 receives 
the "pick 4 from the northeast location" sample message, which was described above with 
reference to FIG. 3, the processor 202 then downloads and displays/plays the sound, image 
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and/or video files for the northeast ("5") location arrow 328 (stage 610). In another example, 
the operator can navigate through the menus on the image display 208 to request that the 
image for the product in the northeast bin 404 be displayed (stage 610). 

In another above-mentioned embodiment, the sound, image and/or video files are 
5 downloaded (stage 604) into memory 204 immediately after the set location message is 
received. These downloaded media content files are then stored in memory 204 under the 
location arrow 328 designated in the message so that the files are immediately available on 
the PTD device 106. The files in memory 204 can be later used to communicate instructions 
and/or other information to the operator. For instance, when the above-discussed "pick 4 

10 from the northeast location" message is received, the processor 202 of the PTD device 106 
retrieves the image file stored under the northeast pointing location arrow ("5") and displays 
the image 320 of the bolt on the image display 208 (FIG. 3). As should be appreciated that in 
other embodiments the operator, through the menu system, can directly view or listen to the 
media content stored in memory 204. It completed that in further embodiments a 

15 combination of the network path storage and direct file storage in memory 204 embodiments 
can be utilized. 

In stage 610, the media content files can be displayed and/or played with the PTD 
device 106 automatically or through user input. As discussed above, the operator can input 
instructions to view the media content via the keypad 210, microphone 212 and/or in other 

20 manners. For instance, the operator can navigate with the menu buttons 304 the menu system 
displayed on the image display 208 in order to display an image of the product. The host 102 
can also send a message that requires the one or more of the files. As noted above, the PTD 
device 106 in one embodiment defaults to displaying or playing the files stored in memory 
204 for a designated location arrow 328 when a service command, such as "pick," "put" or 

25 "count", is received. In a second embodiment, the PTD device 106 needs a specific 

instruction from the host 102 before displaying or playing the files. The PTD device 106 can 
also be configured to display/play certain files by default and require specific commands to 
display/play the remaining files. For example, in a third embodiment, the PTD device 106 
automatically displays image files; while at the same time requires explicit commands before 

30 playing the sound and video files. A sample message from the host 102 for the third 
embodiment is provided below in Table 7. 

Table7 

<?xml version="1.0" encoding="utf-8"?> 
<HTP xmlns="HTP.XSD"> 
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<SID> 1 0.0.0, 1 34</SK)> 
<DID> 1 0.0.0. 135</DID> 
<OP>l</OP> 
<ARW>5</ARW> 
5 <QTY>4</QTY> 
<IND>2</IND> 
<PLY>1</PLY> 
<PLY>4</PLY> 
</HTP> 

10 

When the PTD device 106 receives this "Pick 4" message, the processor 202 will flash 
the indicator light 206 because the indicator tag ("IND") has a value of two ("2"). In 
addition, the PTD device 106 will play the "10-3432. AVI" video file and the "10- 
3432.WAV" sound file. By default, the image of the product in the "10-3432 JPG" file is 

15 displayed on the image display for the northeast arrow ("5") product location. 

As noted above, having the ability to display images or videos of the product at the 
PTD device 106, helps to minimize the risk of the operator picking, placing or counting the 
wrong product. As shown in FIG. 3, the image 320 and description for a bolt along with the 
location arrow 328 is displayed on the image display 208. With the image display 208, the 

20 operator compares the actual item being serviced with the image 320 of the item, and if the 
two do not match, the operator can take the appropriate corrective measures. The image 320 
displayed on the image display 208 can be two-dimensional or three-dimensional image. 
When the image is three-dimensional, the operator is able to move or rotate the image 320 
product via the menu keys 304. Hands free instructions or guidance can be supplied by the 

25 audio file, which can include voice instructions, being played on the speaker 214. 

Furthermore, additional content, such as handling or shipping instructions, can be supplied 
via the image display 208 and/or speaker 214 of the PTD device 106. An example of a 
shipping instruction screen is depicted in FIG. 7. In the FIG. 7 example, the image 320 
displayed on the image display 208 is of a biohazard symbol 702 to alert the operator of the 

30 dangers associated with the item. In addition, handling instructions 704 is displayed on the 
image display 208. It should be recognized from the previous discussion that the PTD device 
106 is capable of generating other types of screens, in addition to those described above. 

While specific embodiments of the present invention have been shown and described 
in detail, the breadth and scope of the present invention should not be limited by the above 

35 described exemplary embodiments, but should be defined only in accordance with the 

following claims and their equivalents. All changes and modifications that come within the 
spirit of the invention are desired to be protected. 
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